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ABSTRACT 

This paper briefly reviews the early efforts at 
forming alumni associations and organizing alumni reunions, describes 
a nunojer of the more recent alumni surveys used in assessment 
activities, and concludes with suggestions for conducting such 
surveys. First, pre-1980 alumni surveys that attempted to measure 
college o'ltcomes are discussed. Next, a list of the goals and 
measures of institutional effectiveness (from a 1980-1989 literature 
review) is provided. Assessment efforts are examined that atteraptea 
to measure school effectiveness through evaluation of alumni careers, 
as well as efforts to measure the satisfaction alujrni felt concerning 
their liberal arts education. Next, a discussion of comprehensive 
alumni studies from the State University of* New York, Albany; Tufts 
University (Massachusetts); and Georgetown University (District of 
Columbia) are provided, as well as a comparative analysis of the 
rankings given from each survey of the three most important abilities 
and skills common to all three surveys and that of the Consortium on 
Fxnancing Higher Education. The use of standardized alumni surveys 
from the American College Testing Service, the National Center for 
Higher Education Management Systems, and the college Board are also 
discussed. The paper concludes with methodological considerations and 
suggestions for conducting an alumni survey to assess educational 
outcomes, contains 38 references and a 57-item bibliography. (GLR) 
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Coliegea In the United State* have long tried to keep in 
touch with their alumni. Earfif effort* were directed at 
forming afumni associations and organizing atumni 
reuniona. it was the economic trauma and uncertainties 
of the 1930s depression that prompted systematic 
assessments of coiiege outcomes. The first for . > titus 
years of these assessments have been wondc utiy 
summarized by C. Robert Pace in his booit, Measuring 
the Outcomes of College (1979). This paper brief'y 
reviews these early efforts, describes a number of the 
more recent alumni surveys used in assessment activi- 
ties, and concludes with suggestions for conducting such 
surveys. 

Alumni Surveys Conducted Prior to the 1980s 

The first attempts to measure coiiege outcomes focused 
on the types of Jobs secured by college graduates and 
how successful these graduates were in finding jobs and 
staying employed. The first such study cited by Pace 
(p.48) was a booic written by John Tunis in 1936. entitled 
Was College Worthwhile? Written by Tunis for the 25th 
reunion of his Harvard Class of 1911, the book covered 
a wide range of topics, e.g., ]obs, family, and civic actlvl. 
ties. What it lacked in hard data, It made up for in 
readability. IMore statisticaity sophisticated efforts to 
examine some of the economic benefits of coiiege were 
conducted during the 1930s by Purdue University (p.51), 
the University of Minnesota (p.51), and the United States 
Office of Education (p.54). 

The ultimate test of respondent patience was pulled off 
successfully by Pace himself in the late 1930s, when he 
surveyed a random sample of 1,381 students who had 
entered the University of {Minnesota during two years In 



the 1920s (p.£>S). Almost 70% completed the 52-3age 
questionnairei Since about half of those entering the 
University in those years received a degree, Pace was 
able to compare both groups. Four general topics were 
covered: (1) earning a living, (2) home/family life, (3) 
soclo-civic affaire, and (4) personal life. 

During the 19408, two major alumni surveys were con- 
ducted, in 1947, Time magazine sunreyed a sample of 
17,000 graduates of over 1,000 of the 1,200 degree- 
graming institutions In the country at that tinie (Pace, 
p.58). Besides employment and satisfaction with college 
and their academic major, the survey probed the gradu* 
ates* attitudes on a variety of civic affairs. 

Another alumni suivey conducted In 1947 involved a 
sample of Syracuse alumni from seven classes going 
back to 1907 (p.63). This sun^ey added severe: importam 
features not included in earlier ones. The first was a 
series of eoucation goals or learning objectivea. The 
answers were cros848buiated with undergraduate majors 
of the respondents. Alumni were also asked their 
opinions on a variety of topics where tiie opinions of 
faculty experts were already known. Responses were 
compared to those of the experts and were cross-tabuiat< 
ed by academic majors. Finally, various activities of the 
alumni were cross-tabulated with the academic majors. 

Pace did not report any significant alumni surveys 
conducted during the 19508. in the sixties, however, 
three were cited. The first (p.76) was by {Robert Calvert, 
Jr. of the University of California, Berkeley. One hundred 
colleges and universities, both public and prh^ate, took 
part in this survey directed to liberal arts graduates who 
were five, ten, or fifteen years out of college. Almost 
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11,009 reaponsM weni reeelvtd, for a rMponas rtt* of 
70% of alumni wtth valld/usibla addressss. Of partlcutir 
interest to Cafvert was th« rafatronshfp of tha arumnPa 
litieral arta education to tlieir aubaequent occupation*. 
When did alumni chorae a career field (before, during, or 
after college}? How tatlsfled were they with their Jobs? 
What valuea did t. i alumni attribute to their liberal 
education? The aurvey also measured involvement In 
cultural, civic, reilgioua, and political actlvittea, in addi> 
tlon to actlvltiea related to their alma mater. 

Many of these aame topica were eomalned In a 1969 
survey (Pace, p.80) by the National Opinion Research 
Center (NORC). This survey waa limited to a aample of 
1961 graduatea from 135 coliegea and universities. 
Besides examining the share of the graduates who 
attained an advanced degree (about a third), the authors 
(Spaeth and Greeley, 1970) probed the alumnl'a feelings 
about their alma mater and their reactlona to various 
aspecta of their college education. One of the more 
interesting aspects of the NORC survey was a series of 
indexes, such aa 'tmerest In the arts" and 'serious 
reading,' calculated for alumni in different careers based 
on current activHttss rttported. 

In 1969, Pace himself conducted a survey of aiumni from 
the class of 1950 from seventy«four colleges and univer- 
sitlea (see Pace. 1972, and Pace, 1974). More than 8.000 
responses to an I8>page questionnaire were secured, for 
a response rate of 58%. The design of the questionnaire 
was simitar to that used at Syracuse In 1947 (Pace, 1979, 
p.63). This design waa based on the work of Louis 
Guttman at the Pentagon during World War ii. Guttman 
acales Invohfed a aeriea of related actlvltiea, arranged In 
aacendino order of complexity or commitment, designed 
to reveal the level of Invohrement of individual respon- 
dents. From answers to related acth/itlea queations, a 
single aeore waa calculated to determine the extern of an 
Individual respondent's involvement 

Using the Guttman approach. Pace sought to assess the 
outcomes of college using the activities, values, and 
opinlona of alumni. Whereas his earlier work at Syracuse 
looked at responses by academic majors and the Calvert 
and NORC surveys examined them by different career 
.fields, In this survey Pace studied differences by type of 
institution attended. What he found were aigntficant 
differences among respondems from various types of 
. institutions. For instance, alumni of vocstionaily orlemed 
Institutions recognized a hiyher relationship between 
their college education and the knowledge needed in 
their careera than did liberal arts graduates. On the other 
hand, liberal arts graduates were more actively Involved 
In humanitles-lype activftles, e.g., arts and literature, than 
were those from carear-reiated programs. 

One of the more interesting questions asked by Pace 
measured the alumnl'a general attitude toward their alma 
mater, e.g., What la your present feeling about your 
college? Responses Included: 'strong attachment to It.' 
30%; "pleasantly nostalgic but no strong feeling,' S0%; 
'more or less neutral,' 16%; 'generally negative,' 3%; and 
•thoroughly negative,' 1%. 

In the 19708, two major studies were reported by Pace 
(1979, pp.91.95). Both related college outcomes to 
employment The first was a study undertaken by the 



Higher Education Reaearch Institute (Solmon, Blscomi 
and Ochsner, 1977). it waa focused on a aubsample of 
indlvldua. who graduated from one of 246 Institutions In 
1961 and who did jm cominue fdr an advanced degree. 
Respondents numbered 5,500, for a response rate of 
72%. Responses were analyzed by type and level of 
employment. Income, Job aatisfactlon, the usefulness of 
skills and knowledge gained ir college to Jol:% and the 
frequency with which the cont&..t of courses In academic 
mnjora was used careers. One of the most notable 
findings waa tha. the quarter of the reapondenta who 
said that their current Job was not related to their aca- 
demic major, only 6% were dlssatlsfled with their jobs. 

in 1976, eleven liberal arts colleges, members of the 
Associated Colleges of the Midwest, surveyed graduates 
of the classes of 1960, 1965, iri70, and 1975 (WIshart and 
Rossmann, 1977). Over 3,300 resi^onses were obtained, 
with a response rate of 61% from the one-year graduates 
and 51% for the older alumni. In aplte of the bleak 
employmem picture in the country at the time, only 4% of 
the men and 5% of the women from the class of 1975 
were unemployed and seeking employment six to nine 
months after graduation. The most notable Innovative 
aspect of this survey was the requested response to a 
ilst of abilities and skills associated with s liberal arts 
degree. Respondems were asked to indicate the extent 
to which these skills and abilities were enhanced during 
undergraduate yeara, and their relative Importance 
subsequently. This approach has been adopted in a 
number of the more recent surveys. 



Alumni Survey Uterature from 1960 to 1989 




The bibliography of thia report highlights the fact that 
alumni aurveya are now widely used by colleges and 
universities. The American Council on Education 
Camput Trend*, f 989 (El-Khawas, 1989) estimated that 
studem learning is being assessed with the use of 'long- 
term outcomes of graduates' by a quarter of all colleges 
and universities and that such assessment Is being 
planned at an additional 44% of campuces. Differences 
by type of institution are listed below: 



Table 1 

Planned or In-Piace Assessment 
of the Long-term Outcomes of Graduates 

Public Public ln(fep«n- 
2-Year 4-Year dent (a») 

AsMSsment In pfac» 26% 22% 26% 

A«teB»ment planned 39% 45% 4^% 



Before we examine types and selected results of some of 
these assessment efforts. If might be helpful to establish 
a framework for them. Leonard Romney (1978). In his 
attempt to Identify measures of 'instttutlonai goal 
achievement,' surveyed 133 trustee*, 41 7 administrators, 
and 600 faculty members at 45 colleges and untversitiea 
to determine the appropriateness of Institutional goal 
areas and measures of achievement in eight of twenty 
goal areas, alumni surveys were identified as appropriate 
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muturemcnt iRstrumentt. Roinney {p.31) identified the 
foltowtng goal ereat and meaiurea of progreaa that 
Invohred aiumni or former atudente: 



Goat Area 

Academic Devet- 
opi^ent 



tnteilectuaf OrU 
entatton 



Measurea of Progress 

Satisfaction of currently enrolled 
students or recent graduates with 
their academic developmem 

Student and/or former student 
performance o»t licensing und 
certification examinations 

Student and/or former student 
perceptions and evaluattona of 
their interest In continued self- 
Initiated study and Inquiry 

Student anchor former student 
ability to formulate and analyze 
problems 

Student and/or former student 
perceptions and evaluations of 
personal development opportuni- 
ties offered at the institutions 

Students and/or former students 
expressing concern for human 
welfare and well-being 

Student and/or former student 
evaluations of the effect of their 
institutional experience on tradi- 
tional religious values 

Utilization by students stnaior 
former students of mechanisms 
(e.g., voting^ petitions) of the polit- 
ical process 

Participation in social, charitable, 
poilticat, or civic organizations by 
faculty, students, and/or former 
students 



For the following goal areas, no aiumni or former stu- 
dents' opinions or activities were listed as appropriate 
measures of Institutlonai effectiveness: Cultum^Aesthetic 
Awareness, Advanced Training, Research, Meeting Local 
Needs, Public Service, Social Egalltariantsm, Academic 
Freedom, Democratic Qovernancet Community, Intetlectu* 
al/AesthetlcEnvIroriment,lnnovatlveCIImate,Off.Campus 
Learning, and Accountability/Efficiency. 

if this paper's bibliography can be used as a guide, most 
alumni surveys aim at assessing the vocational prepara- 
tion goal identified by Romney. Over thifly of the articles 
focus on program review of academic majors. A second 



Individual Per- 
sonal Develop- 
ment 



Humanism/ 
Altruism 



Traditional Reli- 
giousness 



Social Criticism/ 
Activism 



category o^ articles Is concerned with alumni aatlsfaction 
wlthi and perceived utility of, humanities programs. A 
third kind of followmp might b# classified 'comprehen- 
sive,* since a wide variety of outcomes are measured, 
including alumni career, further education, dttzenshlp 
acthfitles, evaluation of educational programs and 
services, and the effects of educational debt Since 
space and time do not permit a review of all of the 
studies, the remainder of the literature review portion of 
this paper wilt discusn a few examples of each type. It 
will also take a took at three standardized alumni survey 
mstruments available. The final section of the paper will 
explore some of the methodology Issues Involved In 
conducting an alumni survey. 

Program Review or Acadeinlc UaJ/om 

Evatuatlons of teacher education programs accoum for 
twenty of the alumni aurvey articles. Typical in methodol- 
ogy, but longer*term than moat, are the efforts reported 
by Fred L PIgge of Bowling Green StMe University (1S78, 
1983, 1984, 1987). Hts articles review efforts to assess 
the outcomes of teacher training at Bowling Green from 
1970 to 19S& For five years after graduation, teachers 
were asked to relate their experiences In the ctsssroom 
to the education they received. They evaluated their 
education In light of on-the-job realities experienced. 
Besides soliciting the views and auggestlons of teachers 
themselves, Pigge surveyed the principals of the schools 
where the teachers were asslgnecL 

Glen Schneider and his colleagues (1987) reported a 
simitar follow-up assessment of high-school vocational 
education program* U Massachusetts. Over 1,2(X) 
graduates were contacted by telephone and asked about 
their employment status, wage rates, and their evaluation 
of training received. Supervisors were sent a aurvey and 
asked to ^omment on the graduates' performance. 
Results of the surveys revealed more satisftictlon with 
technical training than with academic components. The 
survey 8{so revealed discrepancies in mate-female wage 
rates and In perceptions of work habits between some 
graduates and their aupervlsors. 

Both of these assessmem efforts were directly related to 
alumni careers and grew out of efforta to measure the 
effectiveness of 'majors.* Another Interesting project was 
recently undertaken In the California State University 
System. It Is an attempt by %l. Daniel McMliiin and his 
colleagues (McMiltln, Armstrong, All?n, and Nyberg, 
1989) to assess outcomes of five behavioral aclence 
programa, (anthropology, economics, political aclence, 
psychology, and sociology) on nine campuses. Besides 
surveying alumni from the late 1960s to the present, the 
project canvassed current students and faculty. In 
addltton to gathering significant demographic data, 
aiumni were asked to rate several aspects of their major. 
e.g. accessibility of ficutty, helpfulness of the advisor, 
quality of courses, preparation for employment For 
these aspects, and the question. How often did the 
faculty In your lytaf or challenge you to do the very bQ9t 
you could do7, significant differences among depart- 
ments and campuses were revesled. Uke respondents 
In projects cited later, alumni of these behavioral science 
programs Indicated that relative to other skills, speaking 
skills were not strengthened In college. 
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Ahunni Assessmem or LtlMral Alts Progrtmt 

Ont of the ob]sctlvas of tht Atsocltted Coliegot of the 
Mfdwett (ACM) stutfy citMi oartlsr (Wishart and 
Roatntann, 1979) wu to datarmlna tha aatlsfaction of 
ffheraf arts graduataa wKh their education. Reporta on 
this survey, and a similar one conducted In 1984 at the 
University of Virginia (Bender and Hitchcock, 1986), 
focuaed on how aatlafled liberal arte graduates were with 
their education, but on how their level of satisfaction 
compared with that at other graduates. Eighty-five 
percent of ACM graduates were satisfied with their 
college, and 91% of Virginia alumni would recommend a 
liberal arts degree to undergraduatea wishing to enter 
their career field. One use of the data was to provide 
copy for marketing documents for the institutions. 

More comprehensive assessments of early career 
patterns of humanities graduatea were conducted in the 
early 1980s (Sharp and Weidman, 188S; Bechtet, 1984). 
Sharp and Weidman examined data from the National 
Center for Education Statistiea follow-up of 22,000 1972 
high-achool seniors. By 1979, about 2,800 had graduated 
from college. The major fietda of theae graduatea were 
categorized by the authora as follows: Humanities » 576, 
Social Sclencea ■ 557, Liberal Arte and Sciences « 272, 
Education « 758, and Business « 636. The study 
described the types of Jobs held by graduates wit'i 
different majora and their aatlsfaction with work. T!ie 
Sharp/Weldman analysia indicated 'no atgnlflCBnt differ- 
encea* between the Job aatlsfaction of humanities gradu- 
ates and those from other fields, it did, however, find less 
satisfaction with pay by women humanists than by 
wome^ from other fields. 

Contrary to the Sharp/Weldman study, David Bechtel of 
the University of Illinois fcund that humanKiea graduates 
were less satisfied with their jctw than other graduates, 
in his atudy of lllinoia graduates. Bechtel found a wider 
discrepancy in job aatlsfaction between humanities and 
other graduates after one year (69% vs. 86%) than after 
five , eara (86% vs. 03%). Besides analyzing lob satisfac- 
tion from a variety of perspectives, he examined post- 
graduate acth^ftlea. Including education; empioyment 
patterna; t^ow and when first jobs were obtained; and 
attitudea of graduatea toward their undergraduate majors. 
His study Included responses from over 3,100 humanities 
graduates and over 31,000 other alumni from the classes 
of 1970 to 1981. 

Comprehenslvs Alumni Surveys 

Probably the most comprehensive alumni database in the 
nation exista at Smith College, where extensive informa- 
tion is maimained on almost nineteen thousand (62%) of 
ail Smith alumnae. Further education, career patterns, 
comparathre salary patterns, and alumnae afRUatton with 
their alma mater have been studied over time (Coughlln 
and Wiltemae, 1988). One of the more Interesting items 
uncovered by Mary Ann Coughlln and Crane Witiemae In 
their analysis was that recent alumnae are delaying entry 
into graduate school 

In his atudy of State University of New York at Albany 
(SUNY-Albany) graduates from five fields, (business, 
chemistry, English, history, and aoclal welfare), 4. 
Fredericks Voikwein (1989) examined occupations 



entered, incomes and career satisfaef.ion, subsequent 
education, and the current Importance rind enhancement 
while in college of several ablllttes and skills. This last 
Item %vas adapted from the ACM atudy cited earlier, and 
It was also used In a slightly different form In four other 
surveys. The moat imerasttng finding of the SUNY- 
Albany survey la tha degree to «vhich its alumni agree 
with their peera from other achoola about which are the 
most important abilities and akllls in their current endeav- 
ors. While effective oral communication consistently 
ranked high on the lists of abilities and skills important 
to alumni today, it always ranked well down In lists of 
8b;"ties and skills enhanced In college. 

An example of this was a survey of tlie Harvard/Radcllffa 
classes of 1957. 1967, and 1977 (Worth, 1989) whl'.h 
revealed that 96% felt that to 'communicate well orally" 
waa "greatly* important in current endeavors (the highest 
percentage accorded to any of the twelve abilities and 
skills listed), while only 41% indicated that their experi- 
ence at Harvard/Radciiffe had 'great enhanced this skill. 
Similar resutta were uncovered at SUNY<Albany; in a 
aurvey of twelve selective colleges and universities by 
the Consortium on Financing Higher Education, (COFHE; 
Litten, 1989) and at Tufts University (Terkla, 1989) and 
Georgetown University (Pettlt, 1988a, b, and c: 1989). 

The following table compares the ranking of the three 
most Important abltitlea and skills common to ail thre^ 
surveys. fUsten effectively' ranked third in the SUMY 
survey, but it was not listed in the others). 



AitHMlRKildaaof tfM 


TAblft2 
i Moiit ln^xvtMt SkSte « 


MlAbffitiHI 




8UNY 


COFHE Tuftt 


Q#oro9fowR 


Function tRd«p«r»dttnt{y 


2nd 




Itt 


2nd 


Think 4naYytte«Ity 


4th 


2nd 


2nd 


1»t 




3rd 


3rd 


3rd 



The 1987 COFHE survey (Linen, 1889) broke new grounc! 
in that tt foffowed up Individual responses to a 1982 
senior survey at twelve member schools. One of the 
objectives of both the senior and alumni surveys was to 
determine if educational debt inhibited further education. 
Neither survey provided evidence that It did so in his 
report on the survey* Utten noted that the range of 
alumni from the twelve schools who had enrolled for 
further degree work went from a high of 81% to a low of 
59%. Men were more tlkety than women to do so* 77% 
V:? 68%. Besides examining the Impact of debt on further 
education and career patterns^ the survey also asked 
alumni to identify the importance of a variety of consider* 
ations In setecttng a career. Uaing factor analysis, four 
factors were Identified, and for two of these, changes 
were plotted from 19^2 t;i 1987. The first was called a 
Prosperity Factor (secure future, Job availability, high 
Income, and social status). The second was catted 
Social Impact Factor (working for social change, express- 
ing peraonal values and standards). The basic shift over 
time waa an Increased importance Ir the social Impact 
dimension. 
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DtffsrMiOM 


T«bto3 

bitiwMn ImportwiM Todiy ftiKf Enhan^^ 






Gtergetowns 


sa;> n « 2f$40 


ATI lnttitfitlmt>B«> 


n » 31,432 


Skills/ 


EMtntial 
Toitey 


Enhmoad 


EM«ntUU 
TcKliy 


GvMtty 
EnhaiiMd 


SpMk w . 


68% 


28% 


65% 


23% 


OlOOM . • • 


S1% 


26% 


58% 


22% 


Plan ... 


54% 


23% 


54% 


21% 


LMd * 


49% 


16% 


47% 


14% 



Mote: In th9 Wfl» mbon, t/i« following abbmvlmtlonu an 
usQtt: L9ad m 'laad ana auparvlsa taska and groupa of 
paopla' Spaak » 'communlcata wall orally' Choosa > 
'avaluato and chooaa batwaan couraaa of action,' Plan » 
'aatabllah a court* of action to aceompllah goala.' 

The COFHE Instrument was adapted In 1988 for use by 
older alumni (Pettit, 1988 and 1989). Twenty-four colleg. 
es and unEversitlea surveyed selected alumnL Some 
institutions sent the survey to all alumni from seven 
three-year clusters from thti l9S0s to the ISSOs, while 
others limited its use to selocted clusters. Besides the 
consistency with which alumni from different Institutions 
rated tha Importance of the various abilities and akilla 
listed, the most interesting finding was the similarity in 
the gaps that existed between "importance today* and 
'enhanced while undergraduates.* The biggest gaps for 
Georgetown alumni were aiso reWected in the responses 
of otn9r alumni. 

Dawn Geronlmo Terlcia (1989) compared responses from 
Tufts University alumni with those from aiumnt of a group 
of peer Institutions. She found that both groups agreed 
on which aspects of their college experience prepared 
them for activities undertaken later. These were 'course 
work in maior(8)/mlnor{8),* and 'relationships with other 
students.' As mentioned earlier, there was aiso 
agreement among alumni from different Institutions about 
which abilities and skills are Important to aIumR» and 
which ones were slighted during the undergradiates 
years. This prompted Terkia to conclude that, This 
analysis see^is to suggest that higher education institu- 
tions might want to consider ways In which oral commu- 
nication 8k!tls. decision-making, and leadership training 
could be frtfectively integrated into the undergraduate 
eurricutrm.' 

Among the 24 colleges and universities using the modi- 
fied COFHt: Instrument, Carieton Coliegj obtained one of 
the most rompiete sets of responses. Alumni from ail 
seven clusters of classes were surveyed, and responses 
were received from 70%. In their paper on these re- 
sponses, Drodlgan and Rhode (1989) focused on chang- 
es over turn In academic majora, hours worked during 
college, further education pursued, careers and career 
values, ano ch^lc acthrltles. Their comparison of Carieton 
alumni carver values with those of alumni from other 
Institutions prompted them to consider how students who 



come to Carieton differ from those who go elsewhere. 
This linkage of alumni and freshmen profiles was later 
taken up In this author's comparison of advanced 
degreea puraued and careera undertaken by Georgetown 
alumni compered to other alumni. These comparisons 
underscored the concept of Instttutlonai idemities. The 
analysis prompted the hypothesis that instKutionai 
identities are reproduced over time as much by the types 
of students attracted to the InatKution as by what hap- 
pens at the Individual college or university. 

The sense with which an Institution's alumni both reflect 
and help to define the InstKution'a Identity can be seen In 
the articles by Florence Skelly (1986) on the joint 
Harvard/Stanford survey and 5y Daniel Yankeiovlch 
(1988) on Brown Unhrerslty's more recent suwey. The 
Brown survey was especially Interesting, since it was 
motivated by a desire to determine the alumni satisfac 
tlon with the open curriculum adopted in 1969. 

Standardised Alumni Surveys 

At least three standardized alumni surveys are available. 
The first, available from the American College Testing 
Service (ACT), collects demographic data and Informa- 
tion about further education, college experiencea, 
sources of college financing, career planning, and 
placement Provision is made for up to thirty addltionai, 
Institution-specific questions. The National Center for 
Higher Education Management Systems (NCHEIMS) and 
the College Board jointly offer both 'recent • and 'long, 
term* alumni questionnaires. Both ask alumni to Identify 
goala realized white In college and those that have beer, 
or are being realized since college. Alumni are th&n 
asked to Indicate which are currently the three most 
Important goals. Respondents are also questioned about 
their undergraduate majors, any further education being 
pursued, jobs held, and salary received. Space Is 
provided for fifteen institution-specific questions. 

The third standardized form is not, strictly speaking, an 
alumni survey but Is, rather, a four-year follow-up to the 
freshman aurvey of the Higher Education Research 
Instltuto of the University of California, Loa Angeles. The 
latest report on this follow-up, TheAnwlcanCotleoe 
Student. 1987 (Hurtado, Astln, Korn, and Dey. 1989). 
Indicated that nationally 37% of the freshmen who 
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cntffMl college in 1983 griduattd In four yeirs. There 
wae, howevert a wide vartatton by type and admisaion 
aeiecthrityof Inatttutlon. Aa a aurvey of four^year gradu- 
meai it haa the advantage over the other atandardized 
inatrumenta in that tt provldea a fongftudtnal framtworfc 
wRhin which to view reaponaea. Unfortunately, reaponae 
ratea to the aurvey have not tieen high (e.g., only 24% of 
the 16,09S freehmen enrolling In the fall ^ 1983 returned 
the foUow-up questionnaire when it waa matted to them 
in the eummer of 1987). 

Another example of an effort to aaaeaa academic out- 
comea ualng lortgltudlnal compariaona of freshmen and 
four-year graduatea (a an article by Daryl Smith (1990). 
*Women'a Coltegea and Coed Cottegea: la There a 
Difference for Women?* One drawback to all of the 
atandardized forma la the *nt* between the questiona 
asked and the particular institution^ group of alumni, or 
hypotheaea tming Investigated. The advantages (e*g», 
ease of use, preheated questions, comparative data) of 
the standardized forms have to be batanced against their 
disadvantagea (e.g. tack of fir and, sometimes, cost). 

Methodologteal Conatderatkina 

Several excellem articles and publications address 
methodological conaideratione In asseasing academic 
outcomea using alumni aurveya. Three of the most 
helpful resulted from eurveya at community coilegest 
Their lessons are oqualiy applicable to other colieges 
and univeraltlea. The first one that should bo read Is 
'Designing Follow-up Studies of Graduatea and Former 
Students,' (Stevenson, Wailerl, and Japely, 1385). ir.la 
describes lessons from a aurvey at Mt Hood Community 
Collfig^, a medium«^ed suburban eomprehenalve 
womm unity college near Portland, Oregon. Among the 
questlona conitldered were the following: Who la the 
'client* or group that wants the data? What art the 
lasuea to be atudled? What possible practical outcomes 
could result from the survey? The more these ere 
determined before Instruments are selected or designed, 
the greater the likelihood that the results will be useful. 

Another community college survey from the opposite end 
of the country, St John's River Community College In 
Florida, (Williams, 198S) found that response ratea to 
alumni or 'program completer* aurveye could be In* 
creased with brief questicnnalrea contained on pre- 
stamped postcards. An analysis of alternate mailing 
methods Is baaed on a aurvey at Oakton Community 
College In lllinola (Smith and Sera, 1987)* The report 
underacored the Importance of fotlow*up In obtaining 
high response rates. Thie paper recommended a mini- 
mum of two follow-up efforts, the first a postcard remind- 
er and the eecond a tetter with another copy of the 
questionnaire. Armstrong and Lusk (1887) found that 
first-class postage can significantly Increase response 
rates* 

Surveys of teacher education program graduates (Clark 
and Nichols, 1983) revealed that stratified random 
aamplea with follow-up yield more precise estimates of 
outcomes than do one»shot msillngs to emtro slumni 
populations. A particularly good paper on uaes of alumni 
outcomea reaearch in academic planning haa come from 
work at Ohio Stato Unhferalty (Wilitford and Moden, 
1989)* A more complete review of methodological 



cor»alderatlona can tm found .n the recent text. By 
Oes/grt, (Ught, Singer and WHIett, 1990)* Other useful 
references are Surmy Researc/i Metfiods (Fowler, 1984) 
(particularly the aectiona on how largo the sample ahould 
be, responae rates, and nonresponse biss), snd a paper 
on adjusting for nonresponse bias (Whipple snd Muffo, 
1982). 

SuggeatloRS for CcNKluctlng an AfcimiU Stmre^ 
Educsttoral Outcomes 

Based on Insights gslned from the literature cited and the 
experience of coordinating an afumnt aurvey of twenty- 
four collegea and unhrersRles designed to assess educa- 
tional outcomea, the following auggeatlons are offered 
for those who wish to conduct similar studies: 

1. Determine as precise^ as you can the oblectlves for 
the aurvey. Who wama to know the answera to the 
questions sought? What aspects of the curriculum or 
studem eervlces might tie affirmed or changed as a 
result of opinions gathered by the questionnaire? 
Usually answers to these questlona will not readily 
apparent at the beginning of the sunrey project 
Normally a aerlea of discussions will have to tske 
plsce to set the stsge for a meaningftil aunrey project 
tndlvlduala who will be charged with usino survey 
results should Involved as early u possible. 
Acceptance of the survey rnulH will be greatly 
facilitated by 'ownership* of the Instrument and 
methodology used* 

2. Depending on answers to the first questions, choose 
either a standardized instrument or develop one In 
collsboratlon with those who are supporting the 
survey an^ those who will be asked to act on Its 
resulta. If a locally designed Instrument is used, be 
sure to field-test s draft Given the costs Involved in 
credible surveys, only the most important questions 
and subdivisions of data should be Included. 

X Select a sample of alumni whose responses will be 
seen as most meaningful, given the objectives of the 
survey. Think ahead to the tables of data that should 
be included In the analysis. How should the respons* 
es be divided? Cells with smsil numbers of respons- 
es are statistically suspect What will be the likely 
response rate? While response rates of 70% or more 
are desirable, experience has shown that such rates 
are not easy to obtain In alumni aurveys, even with 
proper follow-up. Besides foliow*up by mail, consider 
using phone caira made as part of annual fund soiici- 
tattons aa a follow-up method. If phone calls to 
alumni In the sample are timed to be part of the 
follow-up effort, a thank you or reminder concerning 
the sur^ jy can be added after the solicitation has 
been ttoncluded* In determining the size of the 
sample, the nature of the instrument {e.g», length, 
types of questions asked, apparent Importance of the 
survey), follow-up methods to be used, and the 
historical Involvement of alumni with their alma mater 
are all things to be conslderedt 

4* When the sample la ^tawn^ compare those sample 
characteristics that can be measured (e.g«, 
mate/female aplit class years, groups of zip codes) 
with similar characteristics of the target population 
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unlvertt. B« nun to Indudt In th» Instrument mea* 
luras of thf to chartctorlitlct, Beforo tho tamplt It 
uMd, profiles of sample end unhrsrst should be 
compered to to sure thit stetlstically slgnfflcent 
diffkrences do not exist Later, profifes c? :c«oon- 
dents end the sample should also to examined 

5. Consider the level of confldentlelity to bo used In the 
survey. At s minimum, to sure to Include In the inKiai 
cover tetter an explanation of how responses will to 
used* If respondent kfenttttes are requested^ Include 
the request as an optional feature at the end of the 
questionnaire* Explain how the Identities would to 
used. White such kfentftles facilitate follow*up and 
provide linkages to other datetosss at the bistttutlon, 
they can also suppress the respani^e rttea, particular- 
ly If seneitlve data la roqueated In the aurvey. 

& Estimate the costs invohred, toth out*o^pockM end 
time. Be sure to Include costs of sufficient follow«up 
to achieve a response rate necessary to make the 
effort worthwhile. 



7. Be sure to involve decision makem at the Institution 
In the process enable and raportlng. Plan a 
series of brleftnge to discuss results and to solicit 
questions for subsequent anafyala of the data. 
Provide a range of reports from elmple highlights to 
ln*depth analysts* Look f^ occsstons where euivey 
results esn to useful tt may to a year or more 
toforeclrcumstaneea one campus provideopportuni- 
tiee to use the survey results In a meaningful way. 
Such occasions Include sccredltatlon self-studies and 
currlcuf^r reviews. 

a Finally, keep the aun^eyprojeclinperepectlve. Rarely 
will responses point to inoontestsble conctuslona or 
•pecffte directions for actions. Survey results ere 
most effecthre when they prompt end Inform discus- 
sions smong decision makere, either by confirming or 
challenging prevloualy held opinions or assessment 
results. 
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